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COPYRIGHT NOTICE 
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to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in 
the Patent and Trademark Office patent file or records, but otherwise reserves all 
copyright rights whatsoever. 

Cross Reference To Related Applications and Claim of Priority 

This invention claims priority to the following co-pending U.S. provisional patent application, 
which is incorporated herein by reference, in its entirety: 

Paul J. Ausbeck, Jr., Provisional Application Serial No. [60/213,855], entitled 
"ISOMETRIC JOYSTICK USABILITY," attorney docket no. [20864.01000], filed, June 23, 
2000. 

Field of Invention 

The invention relates to using an isometric joystick to move the cursor on a computer screen 
and to produce button events for the computer's operating system. 

Background of the Invention 

One common feature of the modern computer interface is a mechanism for moving a cursor or 
pointer across the computer's display. For stationary computers the "mouse" is the most common 
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pointing mechanism. A related role for the mouse is to provide a method for attaching 
importance to certain pointer locations. Accordingly, mice universally provide at least one button 
to perform this task. 

Because of space and weight constraints, portable "laptop" or "notebook" computers often use 
a miniature isometric joystick in the role of a pointing device. Figure 1 shows an isometric 
joystick 100 manufactured by Synaptics, Inc. When installed in a computer, the lower portion 
110 of the joystick is hidden below the computer's keyboard with the nub 120 typically 
protruding between the "G" and "H" keys. 

The three dimensions in which the joystick conventionally measures input force are labeled on 
the axis 130 shown in Figure 1. Force in the xy plane parallel to the work surface is used to 
position the cursor. Force in the direction perpendicular to the work surface, z, is used to perform 
selection operations analogously to those performed by the primary mouse button. 

Prior Art 

The isometric joystick with the largest commercial success to date is the TrackPoint system 
from IBM Corporation. Currently, there are at least four patents that relate to improving the 
usability of the TrackPoint system. Two are related to optimizing pointer movement and two are 
associated with synthesizing selection operations. 

Parabolic-Sigmoid Transfer Function 

U.S. Patent No. 5,764,219 argues that the optimal transfer function to tie input force to cursor 
movement is parabolic-sigmoid or S shaped. The trace labeled 'transfer function" in Figure 2 is 
an abstract S shaped transfer function. The key aspects of this shape are the two relatively flat 
regions sandwiched around a region of nonlinearly increasing response. 

At low input forces the output of the S transfer function is also low allowing precise pointer 
movement. For larger forces pointer movement speed is high and fairly constant over a wide 
range of inputs. Ostensibly, this allows the user to develop a more accurate estimate of pointer 
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speed during large movements. A more accurate speed estimate is postulated to help reduce 
target overshoot. 

One problem with the S transfer function is that its derivative is zero at minimum and 
maximum force values. The shape of the derivative of S is shown by the trace labeled 
"derivative" in Figure 2. The first zero in the derivative of S introduces a significant lag between 
initial application of small forces and perceptible pointer movement. At the other end, the 
possibility of target overshoot is increased due to the lag between decreased input force and 
decreased pointer velocity. 

Negative Inertia 

One attempt to compensate for pointer lag is the so-called "Negative Inertia" transfer function 
disclosed in U.S. Patent No. 5,570,1 1 1. The basic S shaped transfer function 

0.=S(F m ) (1) 

of U.S. Patent No. 5,764,219 is augmented with a term that is proportional to the time derivative 
of input force. If G is defined as the gain applied to the time derivative term, the difference 
equation formulation of the negative inertia transfer function is: 

O, =S(F, +G-(F„ -^,)).^— ^A— — (2) 

The primary effect of negative inertia is to provide a response boost that makes the cursor speed 
up and slow down faster, thus compensating for the lag introduced by the S transfer function. The 
response boost is somewhat limited, however, since it is based upon the time derivative of the 
input and only comes into play when input force is changing relatively rapidly. 

In the preferred negative inertia embodiment, G is actually larger than one. Since the output of 
the S transfer function is not defined for negative inputs, when a negative input occurs, S is 
applied to the magnitude of its argument and the sign of the output is reversed. This procedure 
allows for reverse motion or pointer "snap back" when input force rapidly decreases. 
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A significant problem with negative inertia is that the amount of reverse motion is very 
difficult for a human operator to control. Rather than accomplishing the intended task of 
immediately hitting small targets following large cursor movements, it may lead to undesired 
pointer motion just as the operator is fine-tuning the cursor's position. An additional 
complication of the large value of G is that input noise may be amplified enough to add 
noticeable jitter to a slowly moving cursor. The preferred negative inertia embodiment 
incorporates an additional input force deadband to avoid this problem. This extra deadband is 
quite ironic in that one of the primary objectives of negative inertia is to ameliorate sluggish 
cursor acceleration. 

Selection with Motion Correction 

The key problem that must be solved in order to perform selection with an isometric joystick 
is to separate selection information from the predominant movement information. Selection 
information is naturally associated with z axis and movement information with the xy plane. 
However, since x and y forces are produced frictionally some movement information leaks into 
the selection axis and vice versa. 

To overcome this inherent ambiguity, the particular force maneuvers that indicate selection 
must be carefully designed. The selection signature used in the IBM TrackPoint pointing system 
involves both the absolute value of z and its rate of change. The details are disclosed in U.S. 
Patent No. 5,696,535 and the selection signature figure from that patent is reproduced in Figure 
3. 

TrackPoint selection occurs when both z 300 and the first time derivative of z 310 
simultaneously exceed customizable thresholds. Deselection occurs when both z and 
dzjdt simultaneously drop below customizable thresholds. On Figure 3 the z selection threshold 
and the dzjdt selection threshold are labeled "2" and "1" respectively. The deselection 
thresholds are labeled "2" and "3". 
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The TrackPoint selection signature becomes increasingly immune against spurious selection 
as z and dz/dt thresholds are increased. However, robust selection requires z and dz/dt values 
that are large enough that the average user causes significant pointer motion during selection 
operations. For this reason the TrackPoint system also includes the ability to store and later 
unwind pointer motion that occurs during selection or deselection. 

This technique, called motion correction, is illustrated in block diagram form in Figure 4. The 
basic idea is to introduce a sufficient store of input samples to encompass the largest expected 
selection operation. When selection is detected, the input store is scanned backward to locate the 
start of the selection operation. Motion occurring between the start and end of the selection 
operation is reversed, the effect being that when selection occurs the pointer jumps back to the 
position it occupied just before initiation of selection. Correction is applied on deselection as 
well. 

One drawback of motion correction is that the process of moving the cursor and then 
unwinding the motion can be visually distracting or even annoying. A further complication is that 
storing and examining past force measurements can create implementation difficulties. This is 
especially an issue for portable devices where memory and computational resources may be at a 
premium. 

Multiple Selection with Motion Correction 

In U.S. Patent No. 5,912,659 selection with motion correction is extended to encompass 
multiple possible selection operations. The basic selection signature remains the same but when 
selection is detected, motion information in the correction buffer is used to disambiguate from 
among a number of possible selection operations. 

Figure 5 shows the top view of a sphere in the vector space defined by the x, y 9 and z forces 
accumulating during a selection operation. The polar cap, labeled z on the figure, represents the 
normal selection operation. In this region, the force vector that accumulates during selection lies 
very close to the z axis. 
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The annulus surrounding the polar cap represents the region where accumulated xy forces are 
significant but still substantially less than those in the z direction. The annulus can be split into 
one ore more angular regions to define multiple selection operations* For example, the region 
labeled z-y represents an accumulated force vector that lies mostly in the z direction but also 
contains a significant component in the negative y direction. 

The region labeled xy represents accumulated vectors that are more planar than vertical Since 
these vectors are likely due to motion alone, selection operations that accumulate vectors in this 
region are quashed. 

While an interesting idea, multiple selection is difficult to master for a significant user 
population. The most important contribution of the patent is the idea of examining the correction 
buffer for additional clues to help discriminate selection from intended motion. 

Motivation for the Present Invention 

The present inventor has realized that, taken as a whole, the IBM TrackPoint System is fairly 
complex and can be quite difficult for a novice user to master. The S transfer function allows for 
reasonable fine-grained and coarse pointer movement but acceleration and deceleration can be 
perceived as sluggish. This is ameliorated somewhat by negative inertia but the increased 
sensitivity makes it difficult to perform selection operations without incurring significant pointer 
motion. Furthermore, unwinding motion that occurs during selection leads to unpleasant 
extraneous pointer motion and can be relatively expensive to implement. 

Therefore, the present inventor has realized the need for a simpler system for optimizing 
pointer movement and selection operations performed by an isometric joystick. In addition to 
providing for efficient pointing and selection, the system should be easy for a computer operator 
to learn, avoid extraneous pointer motion, and allow for straightforward implementation. 
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Summary of the Invention 

The invention comprises an improvement in the usability of an isometric joystick when used 
as a pointing device controlling a computer display cursor. The invention improves pointing 
performance and selection. 

The present invention includes a device that uses at least one of a plurality of dual-gain 
transfer functions to provide improved pointing efficiency. These transfer functions have in 
common a low gain that is applied to relatively small input forces and a higher gain that is 
applied to relatively larger forces. The preferred function is continuous in the first derivative and 
provides for smoothly increasing pointing gain as input force increases. Pointing gain is 
relatively constant for both small and large input forces and adjusts between the two extremes in 
a manner that minimizes sluggish pointer feel. The preferred transfer function has two terms, a 
low gain that is continuously applied and a higher gain that is blended multiplicatively as force 
increases using an S shaped blending function. 

The invention includes a method for suppressing the high gain portion of a dual-gain transfer 
function. This method exploits the limited human ability to control the rate of decrease of applied 
joystick force. Except for relatively slow rates of decrease from relatively low applied force 
levels, motion accumulated from decreasing forces is almost never desired. The present invention 
minimizes this undesired motion by suppressing the high gain term of a dual-gain ballistics 
function during periods of decreasing pointing force. Unintended motion near the end of coarse 
movements is decreased while fine-grain motion is undisturbed. 

The invention includes methods for performing selection and deselection using an isometric 
joystick are provided. Novel selection and deselection signatures lead to selection discovery 
procedures that require only a single scalar register for holding state. Additionally, a customized 
combined selection/deselection signature is provided for separating intended pointer motion from 
tapping operations. An adjunct mechanism allows for smoothly decreasing selection sensitivity 
as applied forces deviate from the purely vertical. 
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The invention also includes a final disclosure is a method for suppressing motion that would 
otherwise occur during selection and deselection operations. Since human operators almost never 
intend for motion to occur during periods of relatively rapidly decreasing z force, as occurs 
during deselection, motion occurring at such times is discarded. Further, only motion produced 
by forces that lie relatively close to the xy plane is allowed during the periods of relatively rapidly 
increasing z force that are characteristic of selection operations. Discarded motion that is not 
associated with an actual selection or deselection operation remains unnoticeable. 

Brief Description of the Drawings 

Figure 1 shows an isometric joystick with the conventional labeling of input variables. 

Figure 2 shows the abstract form of a parabolic sigmoid transfer function used in the IBM 
Trackpoint isometric joystick system. 

Figure 3 shows the selection signature used in the IBM Trackpoint isometric joystick system. 

Figure 4 is a block diagram of the cursor motion correction apparatus used in the IBM 
Trackpoint. 

Figure 5 shows the multiple selection criteria of U.S. Patent No. 5,912,659. 

Figure 6 is a block diagram of a closed cursor motion control loop of an isometric joystick. 

Figure 7 is a graph of several possible dual-gain transfer functions in accordance with the 
present invention. 

Figure 8 is a graph of derivatives of the transfer functions of Figure 7. 

Figure 9 is a graph of Normalized Input Force vs. Normalized Output Mickey s illustrating 
how gain is selected to take advantage of control asymmetry. 

Figure 10 is a diagrammatic illustration of a selection signature according to an embodiment 
of the present invention. 
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Figure 1 1 is a graph illustrating how selection is detuned as the direction of applied force 
moves away from the z axis. 

Figure 12 is a flow chart illustrating a deselection signature process according to an 
embodiment of the present invention. 

Figure 13 is a diagrammatic illustration of a tap signature process according to an embodiment 
of the present invention. 

Figure 14 is a flow chart illustrating how motion is suppressed in accordance with an 
embodiment of the present invention. 

Detailed Description of the Invention 

Pointer Motion Ballistics 

In classical ballistic motion, a projectile with an initially applied momentum moves under the 
influence of static external forces such as gravity or relatively static forces such as air resistance. 
The required initial velocity of a ballistic projectile is calculated by working back from the 
desired target and applying all the expected forces that occur along the path. In contrast, the 
trajectory of the pointer on a computer display is the result of both an initial velocity and 
continuous monitoring and adjustment by the human operator. Despite this nomenclature 
conflict, the algorithms that relate pointer motion to user input are typically called ballistics 
algorithms. 

A block diagram of elements involved in moving a pointer on a computer display is shown in 
Figure 6. Pointer motion is accomplished via a classic closed loop feedback control system. The 
operator puts force on the joystick. This force is translated into motion reports to the computer by 
the ballistics subsystem. The computer operating system then moves the pointer on the monitor. 
The operator observes the trajectory of the pointer and modifies the input force to more optimally 
approach the target. 
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Because of this closed-loop aspect of the pointer system the chief requirement placed on the 
ballistics algorithms is that the transfer function must be easily learnable by the human operator. 
Subject to this constraint then, the ballistics transfer function must provide for both fine-grain 
and gross movements of the pointer as efficiently as possible. These two constraints lead to the 
following thesis to describe the ideal transfer function: 

The ballistics transfer function must be as smooth and simple as possible subject to the 
constraint that fine grain and gross movement must both be efficiently accommodated. 

Dual-Gain Transfer Function 

The force sensor in an isometric joystick is typically designed so that its output is linearly 
proportional to input force. While a linear output is ideal for mass-producing sensors with a 
standardized characteristic, it is inadequate to provide efficient pointing. The constant of 
proportionality chosen for relating input force and pointer motion leaves either fine-grained or 
gross motions inadequately served. For this reason, the present invention augments the output of 
the force sensor with a ballistics subsystem that alters the basic linear characteristic to one 
especially optimized for the pointing task. 

The ballistics subsystem operates in a sampled environment. The output of the force sensor is 
sampled periodically and the force sample, F m is transformed into M„ mickeys (a mickey is a unit 
that describes a minimum amount of pointer movement) of pointer motion using a ballistics 
function: 

M n =B(F„). (3) 

While the ballistics function is not linear, it is useful to define the instantaneous slope or 
derivative of the ballistics function as its gain. To accommodate fine-grained motion, the 
ballistics gain is set low. High gain is used to accommodate coarse movements. The simplest way 
to accommodate both tasks is with a transfer function with two gains: a low gain, i, applied 
when forces are small and a high gain, H, applied to larger forces. Several possible dual-gain 
transfer functions are shown in Figure 7. 
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Abrupt Gain Transition 

The simplest dual-gain transfer function is one with an abrupt transition between the low and 
high gain portions of its characteristic. In difference equation form this can be written as: 



where a is the input force above which high gain is applied and O is an abstract step function 
which takes on a value of zero when F n is less than a and one otherwise. Note that in this 
formulation low gain is also applied above the transition point. Since L is typically much smaller 
than H, this term does not contribute significantly to the high gain output. In any case, H can 
simply be defined as the difference between the required coarse movement gain and L. The trace 
labeled "Abrupt" on Figure 7 has a gain transition point at 30% of the maximum input force. 



While the abrupt dual-gain ballistic does provide for good fine-grain and coarse pointer 
motion it is not ideal for movements that lie between the two extremes. For medium-grain 
movements the kink in the gain characteristic may become noticeable and any noticeable artifact 
in the pointing apparatus tends to detract from efficient pointing. To eliminate noticeable 
artifacts, the transfer function must be "smooth". The smoothness of a mathematical function is 
related the number of its derivatives that are continuous. The first derivative of the abrupt dual- 
gain transfer function is plotted in Figure 8. As can be seen there is a large discontinuity in the 
derivative at a (Note "a" in Figs. 7 and 8). 

One way to create a transfer function with a continuous first derivative is to smoothly blend in 
the higher gain as force increases; 



M n =L-F n +H-Q(F n -aHF m -a) 9 



(4) 



Blending 



M n =L.F n +H-B(F n )-F n . 



(5) 



The simplest such function that is smooth is the linear blending function: 



B{F n ) = B-F r , 



(6) 



which when substituted into (5) results in: 
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n 



= L-F n +H-F n \ 



(7) 



The curve labeled "linear blend" on Figure 7 is a plot of this transfer function. Its derivative, 
shown in Figure 8, is linear and therefore continuous as desired. However, the gain rises fairly 
quickly from L as force increases and this can slightly degrade fine-grained pointing. Further, the 
gain is not at all constant at larger forces. Therefore gross movements are slightly less efficient as 
the operator never gets a good estimate of the coarse-grained gain. 

A better gain characteristic should delay the onset of increasing gain and then more rapidly 
increase it to a more constant level. This is similar to the familiar S curve, not as the transfer 
function but as its derivative instead! The transfer function with initial gain, L, and having gain 
increase as S is 



This transfer function and its derivative are plotted on Figure 7 and Figure 8 as the traces labeled 
"S Integral Blend". 

The S integral blend transfer function improves upon the linear blend but the gain does not 
become constant until very near the high end of the input force range. More importantly, the 
blending and input force components of the high order gain term are not separable. This can 
create problems when applying the function to signed values of input force and can cause 
anisotropic pointing behavior when the transfer function is independently applied to both the x 
and j input forces. 

A nice way to solve both problems is to use the S function to blend multiplicatively: 



This transfer function and its derivative are plotted on Figure 7 and Figure 8 as the traces labeled 
"S Multiplicative Blend". 

The S multiplicative blend characteristic is a nice synthesis of all the required properties for 
good pointing efficiency. Its first derivative is continuous. Its gain does not increase too rapidly 




(8) 



M n =L-F n+ H-S(F n ).F n . 



(9) 
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in the low force regime. Its gain smoothly climbs as input force increases and is relatively 
constant in the high force regime. This last property is particularly noticeable on Figure 7 since 
for relatively large input forces it is somewhat difficult to distinguish the dual gain and abrupt 
characteristics. 

Isotropic Motion 

A significant problem with applying a non-linear gain to a vector in the xy plane is that if 
gains are independently applied to each vector component, the direction of the vector may be 
changed as well as the magnitude. One way to eliminate this problem is to use the magnitude of 
the raw input vector to select the gain. The magnitude of a two dimensional vector is the square 
root of the sum of the squares of each component, as shown in Equation 10, for example. 

An approximation of vector magnitude that allows for a basic implementation is: 
otherwise. 

If the gain and force terms in a dual-gain transfer function are separable, then the ballistics 
transformation can be made isotropic by using R in the blending term: 

M n =(L + H-B(R n ))-F n . (13) 

Of the previously described transfer functions, the abrupt, linear blend, and S multiplicative 
blend transfer functions are all separable. Their isotropic forms are: 

M n =(L + H.O(R n -a)).F n9 (14) 
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M n = (L + H-R n )-F n , (15) 

and 

M n =(L + H-S(R n )).F n (16) 
respectively. 

Control Asymmetry 

One fundamental aspect of using an isometric joystick to affect pointer movement is that the 
human operator can much more finely control an increase in the magnitude of the input force 
than a decrease. This difficulty in controlling decreasing force becomes more and more 
pronounced as the magnitude of the force increases. For instance, motion accumulated during 
decreasing force intervals may have some vague correlation to the operator's actual intent when 
very fine movements are performed. However, motion accumulated during the rapid decrease in 
force that occurs at the end of a gross movement is almost never desired. 

Because the dual-gain transfer function can be implemented with two distinct gains, the 
asymmetry in pointer control allows for a simple compensation mechanism for target overshoot 
after large movements. The mechanism is to drop high gain motion that accumulates during 
decreases in R, For instance, the S multiplicative blend transfer function remains as before: 

M n =L-F n +H-S(R n )-F n (17) 

dR 

if — >T X (T x zero or slightly negative) and simplifies to 
dt 

M n =L-F n (18) 

otherwise. Use of this procedure with the S multiplicative blend transfer function is illustrated in 
Figure 9. 

Altering the value of the asymmetry constant, 77, can vary the selectivity of the gain switch. 
Note how this mechanism leaves fine-grain pointing completely undisturbed. 
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Fractional Mickey Accumulation 

If the smallest resolvable force is assigned a single mickey of pointer motion, the smallest 
non-zero pointer velocity available from an isometric joystick pointing system is simply the 
sample rate. For example, if T is the system sample rate, then T mickeys/s is the smallest non- 
zero pointer velocity. The typical sample period of 10 ms yields a smallest non-zero pointer 
velocity of 100 mickeys/s, far larger than that useful for fine grain movement. 

A related problem with joystick pointing systems is input noise. If the smallest resolvable 
force is set large enough so that a quiescent joystick never indicates motion, the resulting 
deadband around zero force results in perceptible pointer sluggishness. Both of these problems 
can be solved using the method of fractional mickey accumulation. 

With fractional mickey accumulation the smallest resolvable force is assigned some fraction 
of a mickey that is less than one. Mickeys accumulate until such time as a least a single mickey is 
available. At that time the integral number of mickeys is reported to the operating system and the 
residual fraction is retained. Remarkably, this mechanism acts as a non-linear low pass filter 
whose passband is relatively small for small inputs and relatively large for large inputs. This is a 
very close to optimal solution for the input noise problem. 

Gain Adjustment 

The dual-gain transfer function allows for independent adjustment of H and i. However, a 
single variable gain factor provides good pointer feel across a wide variety of motion 
sensitivities. Normalizing the fine-grain gain to one, the S multiplicative blend transfer function 
can be recast in adjustable form as: 

M n =G,-(F„+H-S(R n )-F n ), (19) 

where G, is an adjustable gain factor and H is a fixed factor larger than the normalized fine-grain 
gain. 
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Selection Operations 

Selection is a mechanism for using z force on an isometric joystick to synthesize presses and 
releases of what would otherwise be the computer's primary mouse button. The selection 
subsystem continually analyzes input force variables looking for particular patterns that emulate 
mouse button events. The pattern that indicates that a button down event should be synthesized is 
called the selection signature. The corresponding pattern that synthesizes a button release is 
called the deselection signature. 

Often a mouse button is pressed and released in rapid succession. The shorthand term for this 
is a mouse button diet A mouse button click can be naturally emulated via a tap on an isometric 
joystick. The input force pattern that emulates a mouse button click is called the tap signature. 
Because a tap can be seen as selection followed rapidly by a deselection a specialized tap 
signature is not a requirement for generating button click events. However, the additional 
temporal information inherent in a tap can be used to more robustly discriminate between motion 
and intended taps. 

Selection Signature 

A natural method for a human operator to signal selection is to apply an increasing z force 
simultaneously with the relative absence of xy force. To detect this selection signature it is 
sufficient to examine the input force variables only when z is increasing sufficiently rapidly. 
During these periods of increasing z, two distinguishing criteria must be met. First the total 
amount of z force applied must reach a certain minimum threshold. Second the total amount of xy 
force applied must be substantially less than the z total. 

A simple mechanism for keeping track of the force applied during periods of increasing z is to 
accumulate a force vector, F, in the dimensions of z and R, where R is the previously described 
magnitude of the xy input force. The difference between the z and R components of V is a good 
indication of the extent to which both a substantial z force and an insubstantial xy force has been 
applied. An example selection signature is illustrated graphically in Figure 10. 
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If instead of separately accumulating both components of V the difference is accumulated, a 
single scalar parameter suffices to track the selection signature. Defining A as the scalar selection 
parameter, its accumulation can be written in difference equation form as: 

4. =4-i +(*„-*■)• (20) 

Selection occurs when A exceeds a configurable threshold, T 3 . By accumulating A only when 



dz 



dt 



dz 



dt 



exceeds a configurable threshold, T 2 , and by zeroing A when 

A will always contain information from a single potential selection action. 
Selection signature discovery is summarized as follows: 
dz 

1. If — >T 2 accumulate the scalar difference of the components of Fin A. 

dt 

dz 

2. If — <=T 2 resets. 



meets or drops below T?, 



dt 



3. If A >= T 3 indicate selection. 
Selection Detuning 

The just described selection signature discovery method has the property of being more 
sensitive to completely vertical presses and increasingly less sensitive to presses that deviate 
from vertical. This detuning property is completely smooth. Defining <j> as the angle that the 
accumulating force vector makes with the z axis, the relative immunity of the of the selection 
signature discovery process to forces applied at various angles is plotted in Figure 11. When § is 
zero, as for a completely vertical press, the normalized force that must be applied is T z units. As <|> 

increases the force that must be applied to indicate selection increases more and more quickly. At 
<|> of approximately 30° the sensitivity has been reduced by a factor of five. For (j> of 45° or 
greater, selection is impossible. 
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The preferred selectivity in discriminating between motion and selection varies from operator 
to operator. This need can be met by allowing customized adjustment of T 3 . As T 3 is increased 

not only is more z force required to indicate selection, but the direction of application must be 
increasingly aligned with the z axis. Therefore, users that require extreme immunity to spurious 
selection can be accommodated without requiring an unduly large selection force. 

Deselection Signature 

Two factors make discrimination of deselection a streamlined operation. First, deselection can 
only occur from the selected state. Second, because of the stateful nature of deselection, a rapid 
dz 

decrease in z, — < T A , can be arbitrarily used as the deselection criterion. Computer operators 
dt 

can easily learn to avoid rapid decreases in z while the pointer is in the selected state. 

However, using rapidly decreasing z as the only deselection criteria may allow for the slow 
removal of the finger from the joystick while retaining the selected state. To avoid this, 
deselection is also triggered by removal of the finger from the joystick. This is indicated by the 
magnitudes of x, y, and z simultaneously falling below a customizable threshold T 5 . An example 
embodiment of the deselection signature discovery process is shown in Figure 12. 

Tap Signature 

A light tap on an isometric joystick is a natural way for a human operator to emulate a mouse 
button click. However, if a tap is light and quick enough, separate selection and deselection 
signatures can fail to detect it. The reason is that an accumulated z force threshold that is tuned 
for discriminating selection from motion is often not reached during the short period of 
increasing z that occurs during a tap. This problem can be solved by taking advantage of 
additional signature information peculiar to tapping actions. 

In a tap gesture, a rapid increase and rapid decrease in z occurs within a certain maximum 
time window. Further, the amount of motion occurring during a tap is conventionally quite small. 
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By adding these constraints to the tap signature the minimum z threshold that must be attained 
can be reduced to a value that is comfortably attained when tapping. 

An example tap signature discovery procedure that works well in practice is shown in Figure 

dz 

13. First a period of relatively rapidly increasing z, — > T 6 , must be detected. During this period 

dt 

of increasing z, a minimum z threshold, z > T 7 , must be attained. A relatively rapid decrease in z 5 
dz 

— < T ft , must then occur. The additional filter is that all three of these events must occur within 

dt 8 

a time window, T 9 , and that motion that accumulates between the detection of rapidly increasing 
and rapidly decreasing z must be less than a threshold, T lQ . 

Motion Suppression 

Rather than unwinding it after the fact, the best way to avoid cursor motion during selection 
and deselection should be to suppress such motion as it occurs. Of course this can only be 
effective if it is possible to quash motion that is potentially associated with selection without 
interfering with pointer movement. Surprisingly, while transparently avoiding all selection 
motion is quite difficult, some uncomplicated techniques can avoid enough motion so that 
selection and deselection are reliably located. 

One advantage of the selection and deselection signatures described in the previous sections is 
that selection criteria are only developed during periods of relatively rapidly changing z. During 
selection, z increases and during deselection z decreases. 

Suppression of unwanted deselection motion is quite straightforward. Relatively large 
decreases in z almost never occur in conjunction with legitimate pointer motion. Deselection 
motion can be largely eliminated simply by suppressing motion that occurs during periods of 
relatively rapidly decreasing z. 

During all periods of relatively rapidly increasing z, pointer motion can potentially occur. 
Ideally, this motion should be suppressed only if selection actually occurs, but allowed otherwise. 



12256578.1 



20 



This is of course arguably impossible to do exactly as the motion must be suppressed before 
actual selection is indicated. 

Fortunately, force samples that represent desired motion are very likely to be largely near the 
pointing plane in the z-R coordinate space. Further, since z and R values are already available as 
part of selection signature discovery, it is a straightforward matter to compare z with R during 
periods of relatively rapidly increasing z and suppress motion unless R exceeds z. 

The motion suppression procedure is illustrated in Figure 14. All force samples are examined 
for possible suppression before they are passed through the ballistics subsystem to form 
operating system motion reports. First, samples that occur during periods of relatively rapidly 

dz 

decreasing z, — <T U , are suppressed. Second, samples that occur during periods of relatively 
dt 

dz 

rapidly increasing z, — > T n , and that are largely vertical, z n > R n , are suppressed. All motion 
dt 

that is not suppressed is allowed. 

Preferred Embodiment 

A sample rate, force sensitivity, and maximum force applicable to using an isometric joystick 
for pointing on a laptop computer are shown in Table 21. 



Parameter 


Preferred Value 


A 


80 samples/sec 


F 


0.8 grams/count 


Fmax 


±511 counts (-400 grams) 



Table 1 



Given an input dynamic range of ±51 1 counts, a function for generating a normalized S curve is: 
l - cos( ) 

S(x) = ^i!2_. (21) 
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Overall, G 5 and high, H, gains appropriate for use in equation 19 are summarized in Table 2. An 
appropriate threshold (Ti) for applying asymmetric gain is also shown in the table. 



Parameter 


Preferred Value 


G 


1.5/256 


H 


16 


Ti 


0 



Table 2 



dz 

A method for approximating — is to maintain a slowly moving average (Za) of z: 

dt 



Za = 



(k-l)-Za n _ x +hz n 



(22) 



dz 

and then obtain — as the difference between the current z value and the slowly moving average: 
dt 



dz _ 
— — z — La . 

dt n 



(23) 



Values of k (number of samples in the moving average) and / (weight of a current z in the moving 

dz 

average) that are applicable to approximating — in selection, deselection and tap signatures are 

dt 

eight and one respectively. 

A useful maximum z force, Z max , for performing selection is 400 grams. Typical threshold 
values for use with the selection, deselection and tap signatures of Figure 10, Figure 12, and 
Figure 13 are shown in Table 3. Threshold values for suppressing motion as described in Figure 
14 are also shown in the table. 



Threshold 


Preferred Value 


T 2 




T 3 


7 


T 4 


-25z 



12256578.1 



22 



T 5 


■03F max 


T 6 


z + .05Z max 


T 7 


■ ^max 


T 8 


-25z 


T 9 


175ms 


Tio 


17mickeys 


Tn 


- 17 


Tl2 


17 



Table 3 



The present invention may be conveniently implemented using a conventional general purpose 
or a specialized digital computer or microprocessor programmed according to the teachings of 
the present disclosure, as will be apparent to those skilled in the computer art. 

Appropriate software coding can readily be prepared by skilled programmers based on the 
teachings of the present disclosure, as will be apparent to those skilled in the software art. The 
invention may also be implemented by the preparation of application specific integrated circuits 
or by interconnecting an appropriate network of conventional component circuits, as will be 
readily apparent to those skilled in the art. 

The present invention includes a computer program product which is a storage medium 
(media) having instructions stored thereon/in which can be used to control, or cause, a computer 
to perform any of the processes of the present invention. The storage medium can include, but is 
not limited to, any type of disk including floppy disks, mini disks (MD's), optical discs, DVD, 
CD-ROMS, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, 
DRAMs, VRAMs, flash memory devices (including flash cards), magnetic or optical cards, 
nanosystems (including molecular memory ICs), RAID devices, remote data 
storage/archive/warehousing, or any type of media or device suitable for storing instructions 
and/or data. 
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Stored on any one of the computer readable medium (media), the present invention includes 
software for controlling both the hardware of the general purpose/specialized computer or 
microprocessor, and for enabling the computer or microprocessor to interact with a human user 
or other mechanism utilizing the results of the present invention. Such software may include, but 
is not limited to, device drivers, operating systems, and user applications. Ultimately, such 
computer readable media further includes software for performing the present invention, as 
described above. 

Included in the programming (software) of the general/specialized computer or 
microprocessor are software modules for implementing the teachings of the present invention, 
including, but not limited to, reading force values and identifying force components, calculating 
force accumulations, integrals, and derivatives, applying gains, recognizing thresholds, 
selections, and tap selections, and the display, storage, or communication of results according to 
the processes of the present invention. 

Obviously, numerous modifications and variations of the present invention are possible in 
light of the above teachings. It is therefore to be understood that within the scope of the 
appended claims, the invention may be practiced otherwise than as specifically described herein. 
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What is claimed and desired to be secured by Letters Patent of the 
United States: 

1 . A method of generating cursor motion on a display from force applied to a user 
controlled pointing device wherein a velocity of said cursor is related to a pointing component of 
the applied force according to a dual-gain transfer function. 

2. The method according to claim 1 wherein a first derivative of said dual-gain 
transfer function is continuous. 

3. A method of generating cursor motion on a display from force applied to a user 
controlled pointing device comprising the steps of: 

a. applying a first relatively low but non-zero gain to said force applied to said 
pointing device; and 

b. applying a monotonically increasing fraction of a second relatively higher gain 
as said force applied to said pointing device increases from zero. 

4. The method according to claim 3 wherein said fraction of said second relatively 
higher gain increases smoothly. 

5. The method according to claim 3 wherein said second relatively higher gain is 
applied only when a magnitude of a pointing component of said force is substantially non- 
decreasing. 

6. A method of indicating selection based on a force applied to a user controlled 
pointing device in which said selection is indicated when, during a period of relatively increasing 
vertical component of said force, an accumulation of said vertical component exceeds an 
accumulation of a magnitude of a simultaneously applied pointing force by a predetermined 
threshold. 
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7. The method according to claim 6 wherein a selection sensitivity is adjusted to 
accommodate different operator preferences by adjusting a value of said predetermined 
threshold. 

8. A method of maintaining selection based on a force applied to a user controlled 
pointing device in which said selection is maintained if a vertical component of said force does 
not decrease relatively quickly and the magnitudes of both the vertical component and a pointing 
component of said force do not fall below a minimum threshold. 

9. A method of indicating a short duration selection operation based on a force 
applied to a user controlled pointing device, comprising the steps of: 

a. determining that a rate of increase of a vertical component of the applied force 
has exceeded a first threshold, 

b. determining that the vertical component of said force has subsequently 
exceeded a second threshold, 

c. determining that a rate of decrease of the vertical component of said applied 
force has subsequently exceeded a third threshold, 

d. determining that said rate of decrease occurred within a certain time interval 
following occurrence of said rate of increase, and 

e. determining that an accumulation over a period subtended by said rates of 
increase and decrease of the magnitude of the pointing component of said applied 
force does not exceed a fourth threshold. 

10. A method of generating cursor motion on a display from force applied to a user 
controlled pointing device wherein a velocity of said cursor is negligible when a vertical 
component of the applied force is relatively decreasing, and is negligible when the vertical 
component of the applied force is both relatively increasing and exceeding a magnitude of a 
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pointing component of the applied force, and is related to the pointing component of the applied 
force otherwise. 

11. A method, comprising the steps of: 
retrieving force inputs from an input device; 

applying the retrieved force inputs to a dual gain transfer function to produce a motion 
signal; and 

applying the motion signal to control an object. 

12. The method according to Claim 11, wherein said input device is a user controlled 
pointing device and said object is a cursor. 

13. The method according to Claim 11, wherein said step of applying the retrieved 
force inputs comprises applying a pointing component of the retrieved force inputs to said dual 
gain transfer function to produce said motion signal. 

14. The method according to Claim 11, wherein a first derivative of said dual-gain 
transfer function is continuous, 

15. The method according to Claim 11, wherein said dual gain transfer function 
comprises M n =L-F n +H • • F n . 

16. A method of generating cursor motion on a display from force applied to a 
pointing device, comprising the steps of: 

generating a force signal from said force applied to said pointing device; 

applying a first non-zero gain to said force signal; 

applying a fraction of a second gain realtively higher than said first gain to said force 
applied to said pointing device, said fraction of the second gain monotonically increasing as said 
force applied to said pointing device increases; and 
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generating motion of said cursor based on the force signal to which said first and second 
gain have been applied. 

17. The method according to Claim 16, wherein said force applied to said pointing 
device is a pointing component of force applied to said pointing device. 

18. The method according to Claim 16, wherein said second gain is higher than said 
first gain. 

19. The method according to Claim 16 in which said fraction of said second gain 
increases smoothly . 

20. The method according to Claim 16, wherein said second gain is applied only 
when a magnitude of a pointing component of the force signal is substantially non-decreasing. 

21. A method of indicating selection based on a force applied to a user controlled 
pointing device, comprising the step of: 

recognizing a period of relatively increasing selection force on said pointing device in 
which an accumulation of the selection force exceeds an accumulation of a magnitude of other 
forces on said pointing device by a predetermined threshold; and 

indicating a selection based on the recognized period. 

22. The method according to Claim 21, wherein said selection force is a vertical force 
on said pointing device. 

23. The method according to Claim 21, wherein said other forces comprise forces 
applied in a direction other than a direction of said selection force on said pointing device. 

24. The method according to Claim 21, wherein said other forces comprise horizontal 
forces applied to the pointing device. 
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25. The method according to Claim 21, further comprising the step of adjusting a 
selection sensitivity of the pointing device by adjusting the predetermined threshold. 

26. A method of maintaining a selection of a pointing device, comprising the steps of: 
determining selection and pointing components of a force applied to said pointing device; 

and 

maintaining a current selection if the pointing component of said force does not decrease 
more than a predetermined rate and magnitudes of both the selection and pointing components of 
said force do not fall below a minimum threshold. 

27. The method according to Claim 26, wherein said selection component is a vertical 
component of said force. 

28. The method according to Claim 26, wherein said predetermined rate is 
approximately l A of a current value of the selection component of said force. 

29. The method according to Claim 26, wherein said minimum threshold comprises 
.03 of a maximum applied force. 

30. A method of indicating a short duration selection operation based on a force 
applied to a pointing device, comprising the steps of: 

(a) determining that a rate of increase of a selection component of said applied force has 
exceeded a first threshold; 

(b) determining that the selection component of said applied force, subsequent to step (a), 
has exceeded a second threshold; 

(c) determining that a rate of decrease of the selection component of said applied force, 
subsequent to step (b), has exceeded a third threshold; 

(d) determining that said rate of decrease occurred within a predetermined time interval 
following the rate of increase determined in step (a); 
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(e) determining that an accumulation over a period subtended by said rates of increase 
and decrease of the magnitude of the pointing component of said applied force does not exceed a 
fourth threshold; and 

(f) indicating a short duration selection when steps (a), (b), (c), (d) 5 and (e) have been 
determined. 

3 1 . The method according to Claim 30, wherein said short duration selection is a tap. 

32. A method of controlling motion of an object from a force applied to a pointing 
device, comprising the steps of: 

(a) applying motion to said object according to a pointing component of the applied force; 

(b) reducing an amount of motion applied to said object when a selection component of 
the applied force is decreasing at a rate faster than a predetermined decrease rate; and 

(c) reducing an amount of motion applied to said object when a selection component of 
the applied force is increasing at a rate greater than a predetermined increase rate and exceeding a 
magnitude of a pointing component of the applied force. 

33. The method according to Claim 32, wherein said object is a cursor. 

34. The method according to Claim 32, wherein an amount of reduction of motion 
applied to said object in steps (b) and (c) comprise setting a velocity of the object to zero. 

35. The method according to Claim 32, wherein said selection component is a vertical 
component of the applied force. 

36. The method according to Claim 32, wherein said selection component is force 
applied in a first direction and said pointing component is force applied in a plane perpendicular 
to said first direction. 
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37. A method of controlling movement and selection from a pointing device, 
comprising the steps of: 

retrieving force inputs from the pointing device; 

applying a dual gain transfer function having a continuous first derivative to a pointing 
component of the retrieved force inputs to produce a motion signal; and 
applying the motion signal to control motion of a cursor; 
wherein: 

said step of applying a dual gain transfer function comprises, 
applying a first non-zero gain to said force signal, and 

applying, if a magnitude of the pointing component is non-decreasing, a fractional part of 
a second gain higher than said first gain to said force applied to said pointing device, said 
fractional part of the second gain increasing smoothly and monotonically as said force applied to 
said pointing device increases from zero. 

38. A method of indicating selection based on a force applied to a user controlled 
pointing device, comprising the steps of: 

determining selection and pointing components of a force applied to said pointing device; 

recognizing a period of relatively increasing selection force on said pointing device in 
which an accumulation of the selection force exceeds an integral of a magnitude of pointing 
forces applied on said pointing device by a predetermined selection threshold; and 

determining a selection based on the recognized period; 

maintaining a current selection if the pointing component of said force does not decrease 
more than a predetermined rate and magnitudes of both the selection and pointing components of 
said force do not fall below a minimum threshold; and 

adjusting a selection sensitivity of the pointing device by adjusting the predetermined 
selection threshold. 
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